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ABSTRACT 

New developments and advancements in informational technology bring about several alternative avenues for educators to select in supporting and 
evaluating their students’ learning. Online portfolio is a fairly new technique in this regard. As the online education grows, use of online portfolio becomes 
more vital for educational programs. At Virginia Tech, in the program of Instructional Technology Master's of Art Degree (ITMA), an online portfolio 
evaluation course is designed with the goals of reviewing and evaluating students’ achievements throughout their master’s degree education as well as 
evaluating the program itself. Evaluation standards put forward by Association for Educational Communication and Technology (AECT) are used as a 
framework in developing this course. 

In this presentation, we first discuss types and content of portfolios and design principles for creating portfolios. Next, we describe the portfolio evaluation 
course and explain briefly evaluation processes involved in the course. We then discuss AETC standards and how the portfolio evaluation course was 
informed by these standards. Succeeding the close examination of this course and its use for the Virginia Tech case, we discuss which regulations and 
standards should be considered in order to successfully apply this online portfolio evaluation course in educational institutions in Turkey. 
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INTRODUCTION 

Portfolio is a fairly new concept in Higher Education in Turkey. It is commonly used in the field of financial investments and 
in describing an artist’s collection of works. Portfolio, in general, can be defined as systematic collection of materials for a 
certain purpose. In the field of education, this term is regarded as collection of students’ works compiled with the guidance 
and directions of an instructor to indicate students’ academic progress and success in their learning process (Alter, Spandel, 
& Culham, 1995). 

As for the electronic portfolio, it is a collection of students’ coursework or independent studies brought together on electronic 
environments. These environments are typically in the form of a CD-ROM/DVD or a web site, and they are convenient for 
storing texts, pictures, and audiovisual files. In the United States, from a professional standpoint, portfolios are used in job 
market for job applications, and in higher education for the promotion of faculty members or for determining and evaluating 
graduate students’ knowledge and skills just before they graduate. When deciding on what works would go into a portfolio, it 
is imperative for a person to consider principles and standards of his/her institution or organization. This notion also plays a 
key role in evaluating a portfolio. We will further discuss types and content of portfolios in the succeeding section. 

In Turkey, graduate students are assessed based on their coursework grading and the qualifying exam results (written and 
oral) in order to be eligible for conducting a thesis/dissertation. Since the exams take place in a short time period, student’s 
performance may be affected by external or internal factors including class environment and student’s psychological and 
physical health conditions. Given that education is generally regarded as a process of bringing desired change in behaviors; in 
the context of graduate programs, students’ academic success and progress need to be evaluated in a more comprehensive 
way and should be spread over a wide-ranging time period. One way of achieving this is by utilizing portfolio in the 
evaluation process. It is important to note here that with the use of portfolio, focus is not on how much a student knows, but 
what a student knows (Hebert, 1998). 

Another important point that needs to be considered is that a faculty member or student has to see portfolio as a tool to 
demonstrate students’ growth along the whole learning process. Considering the portfolio as a final product prevents us from 
getting desired benefits out of it. As Garthwait and Verrill (2003) put it, “e-portfolios are part of the learning process, not a 
result of it" (p. 23). 

Developing a portfolio is a lengthy process. In spite of this, developing a portfolio indicates students’ knowledge and skills 
on the subject at hand, and provides opportunities for students to reflect on their learning and find out about their growth 
(Ahn, 2004). 

PORTFOLIOS: TYPES, CONTENT, AND DESIGN PRINCIPLES 
Types Of Portfolios 

In the literature, portfolios are categorized into three main groups according to their utilization (Smith & Tillema, 1998; 
Winsor, Butt, & Reeves, 1999): 



Portfolio for giving detailed information. This type of portfolio is a compilation of course documents and assignments that 
shows students’ performance on graduate courses. In this type, development of a portfolio does not have to be for the purpose 
of learning. Students’ performance in this type of portfolio is evaluated on the basis of and to the extent of which the 
portfolio meets standards set by the institution. 



Portfolio for learning. 

This type of portfolio is used for proving whether the previously designated principles and standards in the program are 
attained or not. Compilation of documents in the portfolio in keeping with the targeted knowledge and skills has a facilitative 
impact on the search for alternative paths in students’ future success and growth, and their decision making mechanism 
(Messick, 1994). Portfolio for learning has important contributions to the evaluation process in the sense that it shows if 
students have acquired necessary knowledge and skills. 



Reflective Portfolio. 

This type of portfolio is composed of a collection of systematic and continuous works which is directed by a professional or a 
person himself/herself to improve a person’s comprehension capacity. This type of portfolio possesses evidence in finding 
out a person’s professional work experience. (Smith, 1998). 



An E-portfolio Template 

In this section we will present a template for an e-portfolio. Although the template presented below is primarily designed for 
Master’s and doctoral students, its content can be modified to fit into individuals from various disciplines and different levels 
of academic backgrounds. 



Introduction 

Students should articulate their goals in developing an e-portfolio in this section. Furthermore, this section can be a good 
place for students to give brief information about their curriculum vitae. 

Accomplishments 

Students should present their achievements and accomplishments in this section. This section can include awards, grants and 
other credentials students have received, as well as their work experiences such as internships and assistantships. Pictures and 
video clips can be used to evince these accomplishments. 

Educational philosophy 

Students should state their educational philosophy regarding their field of study. 



Projects 

In this section, students should present their projects, thesis and assignments coming from independent studies or from the 
courses that they are taking or have taken. Presenting abstracts of these documents on a page helps people who examine the 
e-portfolio. 



Principles and standards 

In this section, principles and standards which are set by institutions that the students attend should be presented. Essentially, 
it can be said that this section is the most important part of an e-portfolio, because by examining this section one can 
understand if the students meet the existing principles and standards. In this section, the students ought to give links to their 
projects, thesis, and assignments that are related to each principles and standards. 



Curriculum Vitae 

A comprehensive curriculum vitae written chronologically should be presented in this section. The point that needs to be 
taken into consideration in this section is that ordering of both professional positions held and academic publications needs to 
be from newest to oldest. 




Reflections 

Projects, assignments and other studies carried out up to that time and students’ thoughts related to the field that they are in 
should be in this section (Sivakumaran & Wishart, 2003). 



Design Principles To Consider In Developing An E-Portfolio 

We discussed above types and content of an e-portfolio. Another crucial point that needs to be considered when developing 

an e-portfolio is design principles. These are given below in order: 

1. Navigation - Can you go to wherever you want? There has to be a user-friendly and easily accessible navigation to be able 
to access sections and pages in the e-portfolio. Links among the pages have to work flawlessly. 

2. Functionality - Can you view the content? The content of an e-portfolio has to be readable and structured in a way that 
does not make eyes feel tired. Use of unnecessary bright writing fonts should be avoided. If the content of the portfolio 
requires supplementary plug-ins and programs such as Flash Drive or QuickTime, they have to be embedded and checked 
to see if they are running properly. Providing links to the web sites where these programs can be downloaded would also be 
helpful. 

3. Relevance - Is the content related to the field of study? The content of projects has to be relevant to the principles and 
standards. 

4. Amount of content - Is the content adequate and accessible. There has to be as much as necessary amount of content in the 
project section that covers the principles and standards. 

5. Appearance - Is everything attractive? In addition to existence of necessary content, the presented content also has to 
attack users’ attention. Same design template should be used throughout the e-portfolio, and all the pages should be linked 
with one another (Portfolio Evaluation Course Notes, 2007). 



IMPLEMENTATION OF PORTFOLIO EVALUATION COURSE 

The Instructional Technology Master’s of Arts Degree (ITMA) program is a distance learning program which was 
established in 1998. Although it was originally designed for K-12 practitioners in the State of Virginia, currently it is a 
nationwide program offering the degree for students who are educators in K-12, community colleges, and higher education, 
as well as corporate trainers and other instructional design and development professionals outside of the academic world. 
Since ITMA is a distance program, all courses are offered online and students are required to take 30 credits to complete their 
Master’s degree. 

There is a two-level assessment conducted in the ITMA program to assess student’s performance (ITMA, 2007). 

• The course level assessment which is conducted through course-related assignments. 

• The program level assessment which is conducted through a summative review of the student’s electronic portfolio. 

In the ITMA program the portfolio also gives students a great opportunity to demonstrate their skills and knowledge in the 
following areas: 

• Web page creation 

• Multimedia production to support student’s learning 

• Development of educational research 

• Electronic presentation development 

• Software evaluation (ITMA, 2007) 

The Portfolio Evaluation/Presentation is a required course for students who complete all coursework in the ITMA program. 

Adhering to a summative evaluation method, ultimate goal for this course was to be able to determine the students’ 
achievements over a period of time, to encapsulate the development and progress, and to report the results to related 
stakeholders (Scriven, 1991; Shambaugh & Magliaro, 1997). Student portfolios are evaluated according to the published 
standards established by the Association for Educational Communications and Technology (AECT). These standards have 
been used by the National Council for Accreditation of Teacher Education (NCATE) to review the academic programs in the 
United States and are divided into five interrelated domains: design, development, utilization, management, and evaluation. 
Also, each domain includes subdomains which represent the major characteristics of each domain. These domains and 
subdomains are represented in Figure 1 (Seels & Richey, 1994, p. 21). 





Figure 1 : Domains of the field 

According to Seels and Richey (1994), the design domain shows the necessary knowledge and skills for students to be able to 
design conditions for learning by applying principles of instructional design, message design, instructional strategies, and 
learner characteristics. The development domain refers to the actual creation of instructional materials and experiences, as 
well as products. The utilization domain includes the use of processes and resources for learning. The management domain 
focuses on the application of principles of projects, resources, delivery systems, and information management to the 
planning, organizing, coordination, and supervision of instructional technology. The evaluation domain refers to the 
application of the principles of problem analysis, criterion-referenced measurement, formative and summative evaluation, 
and long-range planning to the evaluation of the products and processes of learning. 

AECT has also provided a list of indicators which are associated with these domains and their subdomains. More information 
about the domains and performance indicators can be found at www.aect-members.org/standards/initstand.html. These 
indicators are not only used to assess student performance and whether or not they comply with the AECT standard, but also 
provides the ITMA program a resource to present evidence of student outcomes to the accreditation body. 

In the Portfolio Evaluation course, students need to develop their own portfolios that are aligned with the guidelines, formats, 
and standards. In order to develop their portfolios, students should be able to use some kind of web development software 
such as, Dreamweaver© and Frontpage©. Once portfolio developed, students should submit their work to a group of peers. 
They are responsible for evaluating their own portfolio, as well as some of their peers’ portfolios. Therefore student can take 
advantage of peer evaluation to modify or enhance their portfolios before the final submission to the faculty. By having peer 
evaluation conducted in this course, students are expected to reflect on not only how evaluation is conducted in terms of 
formative and summative perspectives, but also how peer evaluation assists them in identifying deficiencies in their 
portfolios (Topping, Smith, Swanson, & Elliot, 2000). 

After peer evaluation, students have to submit their portfolios to the faculty for final evaluation. In the Portfolio Evaluation 
course, peer evaluation can be considered as formative evaluation which is an ongoing evaluation to revise and improve the 
portfolio (Scriven, 1991; Weston, Me Alpine, & Bordonaro, 1995). On the other hand, faculty evaluation can be viewed as 
summative evaluation which focuses on the final product to determine what has been achieved over a period of time, to 
summarize the progress, and to report the findings (Scriven, 1991; Shambaugh & Magliaro, 1997). In the final evaluation, 
faculty members decide if students meet the portfolio requirements. If students meet the requirements, they will be awarded 
with Master’s of Arts degree in Instructional Technology. 

In the Portfolio Evaluation course, AECT standards are used as advance organizers to determine the achievement of 
educational objectives (Stufflebeam, 2001). Accreditation history in the United States shows that standards establishment is 
the foundation of accreditation (Yilmaz, 2007). Today, within the accreditation process, special attention is given to 
assessment of student learning and outcomes (Miller, 2000). Therefore, using AECT standards and requiring students to 
organize their work in the portfolio according to these standards are crucial to show the evidence of the student learning and 
development. 



PORTFOLIO IN TURKISH EDUCATIONAL INSTITUTIONS 

The use of portfolio assessment in evaluating students’ learning and development in Turkish higher education at the level of a 
course is sporadic and only exist as an effort of individual faculty members (Gulbahar & Tinmaz, 2006). Furthermore, 



existing practices suffer lack of systematic implementations of portfolio assessment. On the other hand, the use of portfolio 
assessment is almost non-exist at the program level. 

However, the recent changes in curriculum and evaluation in the pre-college education call for use of alternative assessment 
methods to evaluate students learning process (MEB, 2003). Exhibits, portfolios, concept maps, or oral presentations are 
some of these alternative assessments (Herman, 1997). In this context, the authors of this article believe that use of portfolio 
in tertiary education can also bring a new perspective to the assessment of student performance. This notion is also supported 
by the teacher qualification indicators, which were established by an Educational Commission in 2004. This Commission was 
composed of representatives from the related units of the Ministry of National Education, the pool of Turkish university 
representatives, teachers, superintendents, and measurement and evaluation specialists. The commission identified six main 
qualification domains, 31 sub-domains, and total 221 qualification indicators related to these domains and sub-domains. 
These qualifications were designed to improve not only teacher qualifications through pre-service and in-service training, but 
also student achievement. Of the six main domains, one is primarily germane to our work: “Monitoring and evaluating 
learning and development” (MEB, 2006, p.3). Under the heading of this qualification domain, the Commission documented 
several indicators by placing emphasis on the use of alternative assessment tools in teaching and learning. One of the 
indicators specifically states that teachers should identify and use alternative assessment tools (MEB, 2006). Additionally, 
this indicator raises the critical need for having teachers to get familiar with and comprehend different ways of using 
alternative assessment tools, including portfolio in their classrooms to assess student performance. 

Even though some initiatives have been started and works have already been done in the direction of bringing standards to 
higher education in general and teacher education in specific such as, the creation of teacher education indicators; there is still 
a need for comprehensive and detailed guidelines and standards, like AECT standards in different disciplines. These 
standards certainly should be informed by and consider both international standards, and the requisites and realities of 
Turkish Educational context. We also believe that establishment of discipline specific standards based on aforementioned 
considerations will assist us in effectively utilizing portfolio evaluation courses in the Turkish higher education system. 

CONCLUSION 

The traditional assessment strategies that are perceived merely as a monitoring mechanism fail to address needed skills such 
as, problem solving, reasoning, connections, and cooperation. In response to this problem, alternative assessments have been 
developed. Portfolio, particularly electronic versions, can be regarded as one of these assessments. It allows students to see 
and control their academic development and success rather than just showing if students reach certain criteria in a 
quantitative sense. Our experiences in Virginia Tech showed that students can be able to actively participate in their own 
learning and so that the process of attaining to higher-order thinking and universally-accepted important skills may be easier 
and quicker. It is undoubtedly important in this sense that Turkish higher education should learn from international 
experiences and knowledge base. 
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